Gamified crowdsourcing for idiom corpora construction

Abstract Learning idiomatic expressions is seen as one of the most challenging stages in second-language learning because their unpredictable meaning. A similar situation holds for identification within natural language processing applications such machine translation and parsing. The lack high-quality usage samples exacerbates this challenge not only humans but also artificial intelligence systems. This article introduces a gamified crowdsourcing approach collecting materials expressions; messaging bot designed an asynchronous multiplayer game native speakers who compete with each other while providing nonidiomatic examples rating players’ entries. As opposed to classical crowd-processing annotation efforts field, first time literature, crowd-creating & crowd-rating implemented tested idiom corpora construction. language-independent evaluated on two languages comparison traditional data preparation techniques field. reaction crowd monitored under different motivational means (namely, gamification affordances monetary rewards). results reveal that proposed powerful targeted materials, although being explicit approach, it found entertaining useful by crowd. has been shown have potential speed up construction be used material, training supervised systems, or lexicographic studies.